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Abstract 

We investigate temporal coherence and spatial synchronization on small- world networks consist- 
ing of noisy Terman-Wang (TW) excitable neurons in dependence on two types of time-delayed 
coupling: {xj[t — r) — Xi{t)} and {xj{t — r) — Xi(t — t)}. For the former case, we show that time 
delay in the coupling can dramatically enhance temporal coherence and spatial synchrony of the 
noise-induced spike trains. In addition, if the delay time r is tuned to nearly match the intrinsic 
spike period of the neuronal network, the system dynamics reaches a most ordered state, which 
is both periodic in time and nearly synchronized in space, demonstrating an interesting resonance 
phenomenon with delay. For the latter case, however, we can not achieve a similar spatiotemporal 
ordered state, but the neuronal dynamics exhibits interesting synchronization transition with time 
delay from zigzag fronts of excitations to dynamic clustering anti-phase synchronization (APS), and 
further to clustered chimera states which have spatially distributed anti-phase coherence separated 
by incoherence. Furthermore, we also show how these findings are influenced by the change of the 
noise intensity and the rewiring probability. Finally, qualitative analysis is given to illustrate the 
numerical results. 
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I. INTRODUCTION 



Neuronal networks from living biological entities to various theoretical models have gained 
great research attention in recent years [ij]. As we know, neuronal networks consist of 
chemically coupled or functionally associated neurons, the connections among them can be 
formed by electric synapse or chemical synapse. In the vertebrate cortex, a neuron can be 
connected to as many as 10^ postsynaptic neurons, so the way in which neurons process 
and transmit information among each other is an important subject of research. Many 
experimental evidences demonstrate that neurons transmit information by processing them 
into action-potential sequences (spike trains), and spatial synchronization as well as temporal 
coherence of neuronal spike trains are crucial for coding and transmission of information 
across the neuronal networks [3, 3|. In the past two decades, extensive research has been 
performed with the aim of analyzing spatial synchronization and temporal coherence of 
neuronal dynamics, and many insightful findings have been reported. 

On one hand, neurons are noisy elements, where noise arises from both external (e.g., 
synapses) and internal (e.g., channels) sources. The effects of noise on firing dynamics of 
neuronal networks, especially synchronization and temporal coherence, have been widely 
studied. For instance, Gaussian white noise can induce coherence resonance in FitzHugh- 
Nagumo (FHN) and Ho dgkin- Huxley (HH) neuronal models 4-6], Perc et al. j?, 8| showed 
that channel noise in coupled HH neurons can control the spontaneous spike regularity, and 
the effects of correlated noise on spike coherence and spike firing rate of coupled neurons 
have also been investigated thoroughly in various neuronal systems js - 11| by Kurths. On the 
other hand, due to the complex topological connections, real neuronal networks often exhibit 
small- world and scale- free features Q,!^ , s o sp atiotemporal dynamics on complex neuronal 



networks has attracted increasing attention 14l4l7l| . In previous works, we found that spatial 



synchronization and temporal coherence, which are practically absent in regular networks, 
can be greatly enhanced by random shortcuts between the neurons 18|42Q|- Stochastic 



resonance on small-world neuronal networks via a pacemaker was also investigated by Perc 



21 



22| . and Kwon 23|] reported that coherence resonance can be considerably improved by 



small-world connectivity in networks of HH neurons. Moreover, spatial synchronization and 



2J-l27|. 



stochastic resonance have also been extensively studied on scale-free networks 

As is well known, information transmission delays are inherent to the real neuronal net- 
works because of the finite speed at which action potentials propagate across neuron axons 



2 



and the time lapses occurring in both dendritic and synaptic processing. For example, the 
speed of signal conduction through unmyelinated axonal fibers is on the order of 1 m/s, 
resulting in time delays up to 80 ms for propagation through the cortical networks [28 1. 
It is thus important to understand how the dynamics of coupled neuronal ensembles are 
infiuenced by such delays. A number of interesting effects of time-delayed coupling on the 



qualitative and quantitative properties of neuronal 



ture, including both chemical synapse coupling 
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dynamics have been reported in litera 



35| and electric synapse coupling 



36 



-|52|. 



For instance, time delays through chemical synapse can induce synchronization in coupled 



integrate-and-fire 



29| and bursting Hindmarsh-Rose (HR) neurons 32|, tame chaos on scale- 



free neuronal networks [33]. Moreover, Wang et al. found synchronization transitions from 
chaotic to periodic motions in two coupled FHN neurons 34|, as well as transitions be- 



tween in-phase and anti-phase synchronization in two coupled fast-spiking neurons |35|. 
Compared with chemical synapse, time delays through electric synapse are more usual in 
academic research. People have found that time delay through electric synapse can facili- 



;ate and enhance neuronal synchronization 36l-l38l|. induce various spatiotemporal patterns 



n 

39[, enhance spatiotemporal order in coupled noisy small- world neuronal networks [40|. In 
addition, Perc and his cooperators have contributed some remarkable findings in this field, 
they found that information transmission delay can induce transition from zigzag fronts to 



scale-free neuronal networks 



4l| and further to regular in-phase synchronization 



clustering anti-phase synchronization 

on small- world neuronal networ ks |42 |. intermittently induce synchronization transitions on 



4^ . 46 1 . Furthermore, they also showed that delay can enhance 

, ISOj and induce 



coherence of spatial dynamics in small-world networks of HH neurons 149 
multiple stochastic resonances on scale-free neuronal networks 
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52| . they proved that 



delay-induced multiple stochastic resonances are robust to the changing of the scale-free 
networks, even when the nodes of the network are more than 10000. 

It is worth noting that in the aforementioned literature electric synapse coupling with 
delay is described by {xj{t — T) — a;j(t)}, whereas as we know, there exists another important 
scheme of delays through electric synapse which is defined by {xj{t — r) — — r)}. This 
type of coupling has been widely used to investigate synchronization problems in various 
fields such as electric circuit [53 , 



coupled pendulums [55|], delayed neural networks 
57H63| . In a recent paper, we have showed that the former 



(DNNS) [565, ^^"^ general models 
;ype of delayed coupling can enhance spatiotemporal order in coupled neuronal systems 
40|. However, little attention has been paid to the impact of the latter type of coupling 



scheme on the spatiotemporal dynamics of neuronal networks. Furthermore, to this day, 
the differences between the effects of these two types of delayed coupling on spatiotemporal 
dynamics in coupled neuronal systems have not been studied. Thus in this paper, we aim 
to extend the scope of above-mentioned investigations by comparing such differences. To do 
this, we investigate temporal coherence and spatial synchronization on small-world networks 
consisting of noisy Terman-Wang (TW) excitable neurons in dependence on these two types 
of time-delayed coupling. We show that with same coupling strength and delay time some 
distinct results induced by these two different types of coupling can be achieved. For the 
former case, it is found that time delays can dramatically enhance neuronal synchrony and 
temporal coherence. In addition, if the delay time is tuned to nearly match the intrinsic 
spike period of the neuronal network, the system dynamics reaches a most spatiotemporal 
ordered state, demonstrating an interesting type of resonance phenomenon with delay. For 
the latter case, however, we can never find a similar spatiotemporal ordered state, whereas as 
the delay time is increased, the neurons exhibit synchronization transition from zigzag fronts 
of excitations to dynamic clustering anti-phase synchronization, and further to clustered 
chimera states. Furthermore, we also show how these findings are influenced by the change 
of the noise intensity and the rewiring probability. Finally, we give some qualitative analysis 
to illustrate the numerical results. 

The remainder of this paper is structured as follows. In Secjll] Terman-Wang neuronal 
networks with two types of time-delayed coupling are employed to simulate neuronal dy- 
namics. Main results are presented in SeclIIIt followed by conclusions and discussions in 
SeclIVl 



II. MODEL DESCRIPTION 



The two-variable Terman-Wang (TW) model is similar to the famous FHN model, it 
was first proposed by Terman and Wang [64] to simulate neuronal oscillations discovered 
experimentally in visual cortex. We consider here N coupled TW neurons with delayed 
coupling, subjected to additive Gaussian white noises and external signal. The system 
dynamics can be described by the following equations: 

Xi = 3xi — xf + a — Hi + I + D^i{t) + Gi (la) 
l/i = ^/'[7(l + tanh(xi//3))-?/i] (lb) 
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Here, i = 1,2, ... ,N specifies the neuron index, variables xt and i/i denote the action po- 
tential and the channel activation level of neuron i, respectively, a; is a fast variable and y 
is a slow one. ip is a small parameter which measures the time scale separation between the 
dynamics of x and y. a, /3, 7 are model specific parameters. We consider that all the neurons 
are identical and fix ip = 0.02, a = 1.99, /3 = 0.1, 7 = 6.0 throughout this paper unless speci- 
fied otherwise. / represents a homogeneous subthreshold periodic stimulus current delivered 
externally to the neurons, and we set I = 0.01 sin(27rt/9). It should be noted that changing 
the amplitude and frequency of such a subthreshold periodic stimulus I does not affect main 
results of this work. C,i{t) stands for independent Gaussian white noise with unit variance, 
i.e., (^i(t)) = 0, {C,i(t)^j(t')) = 6ij6(t — t'). For these parameters, an isolated TW neuron will 
stay in the rest state in the absence of noise. Gi is the coupling term, which represents inter- 
action between all other neurons and neuron i. In this paper, we employ two types of electric 
synapse coupling with delay, {xj(t — T) —Xi(t)} and {xjit — r) — — r)}, thereinto, r is the 
transmission delay. Thus the coupling term Gi can be described by e ^ Aij [xj (t — r)— xi (t)] 

and Aij[xj{t — t) — Xi{t — r)], where e is the coupling strength. The adjacency matrix 

j 

A denotes connectivity of the neuronal network, with entry Aij = Aji = 1 if neuron i and 
j are connected, and otherwise. An is set to 0. Numerical integration of Eq.(l) is carried 
out by using explicit Euler method with time step 0.003. Finally, we should note that for 
convenience, the two types of delayed coupling {xj{t — r) — Xi{t)} and {xj{t — r) — Xj(t — r)} 
are defined as type I and type II coupling respectively in the remainder of the paper. 

III. RESULTS 

In what follows, the effects of these two types of coupling on temporal coherence and 
spatial synchronization in small-world networks consisting of noisy Terman-Wang (TW) 
excitable neurons are presented. Since we are mainly interested in the effects of delayed 
coupling, here we start from a regular network with periodic boundary condition consisting 
of = 200 TW neurons, each having K = 8 nearest neighbors, and the coupling strength 
is fixed at e = 0.1 throughout this paper. Results shown in Fig{T] and Fig|2] illustrate the 
spatiotemporal dynamics of neurons with type I and type II coupling, respectively. In both 
plots, from left to right the delay time r equals to 0,0.3, 1.0, 1.8, and 3.0. Clearly, distinct 
spatiotemporal patterns can be observed with different types of coupling. In FiglH initially, 
in the absence of time delay [see panel (a)] the snapshot is rather turbulent, both in space 
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Neurons(i) 



FIG. 1: Space-time plots of TW neurons with type I coupling for different delay time r. From 
left to right, r equals to 0,0.3, 1.0, 1.8 and 3.0, respectively. Other parameter values are A*" = 200, 
if = 8, and D = 0.6. 

and time. With increasing r, say, r = 1.0, a considerable enhancement of regularity can be 
observed. When the delay time is further increased, e.g., to 1.8, as shown in the fourth panel, 
the system reaches a strikingly ordered state, where all the neurons are almost synchronized 
in space and periodic in time. However, if we further increase r, the ordered state begins 
to be deteriorated (e.g., r = 3.0). These observations thus demonstrate that moderate time 
delays can enhance both temporal coherence and spatial synchronization of coupled TW 
neurons with type I coupling . Furthermore, presented results indicate typical resonant 
phenomenon, i.e., for an optimal delay time, the spatiotemporal regularity of the system 
can reach a clear-cut maximum level. We note here that such phenomenon has already been 



reported in our previous paper [40l], and we present it here for clear-cut comparison with 
the type II coupling and self-consistency of the present paper. 

The situation in Figj2]is totally different: we can never derive a similar spatiotemporal 
ordered state, but non-trivial synchronization transitions phenomena induced by time delays 
in type II coupling can be found. When r = 0, the plot is the same as Fig{T](a). For non-zero 
yet short delays (e.g., r = 0.3), zigzag fronts of excitations appear, as shown in Figj2](b). 
In Figj2]J^c), however, alternative layer waves are present where excitatory spikes occur al- 
ternatively among nearby clusters in space as the temporal dynamics evolves. Hence, this 
phenomenon can be termed appropriately as a clustering anti-phase synchronization (APS) 
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Neurons(i) 



FIG. 2: Space-time plots of TW neurons with type II coupling for different delay time r. From 
left to right, r equals to 0,0.3, 1.0, 1.8 and 3.0, respectively. Other parameters are the same as in 
Figffl 




FIG. 3: (a) An inset of Figl2j:, enabling a clearer demonstration of the clustering anti-phase 
synchronization, (b) An inset of Figl2^, displaying explicit clustered chimera states, (c) Time 
series of membrane potential of two nearest neurons. From top to down, the APS state, spatial 
incoherence part and anti-phase synchronization part of clustered chimera states are exhibited. 
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transition induced by an moderate time delay, which is quite distinct from the spatiotem- 
poral pattern in FigJU^c). As r is further increased to r = 1.8, the APS is heavily impaired. 
Finally, when r = 3.0, intriguingly, clustered chimera states [65] which have spatially dis- 
tributed anti-phase coherence separated by incoherence can be observed [see panel (e)], and 
this interesting phenomenon can not be found in type I coupling. For clearer illustration, 
we plot the local enlargements as well as the time series of two nearby neurons for r = 1.0 
and r = 3.0 in Figl3|, where the APS state and clustered chimera states can be shown more 
explicitly. Finally, the synchronization transitions displayed in Figj2] could be explained by 
the mechanism that this type of delayed coupling can introduce phase slips, and hence zigzag 
fronts and alternative layer waves even chimera states can appear, thus supplementing the 
purely noise-induced excitations. 

To quantitatively characterize the spatiotemporal dynamics of the neuronal systems, we 
introduce the coefficient of variance (CV) of the inter-spike intervals (ISI) and the standard 
deviation factor a to measure temporal coherence and spatial synchronization, separately 
. CV is defined as 

where {■)t denotes averaging over time, Tj is the ISI of neuron i . By further averaging Aj 
over different neurons, we get A = "^i^i/N as the CV of the coupled neuronal network. 
Obviously a larger A means better periodicity in time. The standard deviation factor is 
defined as a = {a(t))t, where 



a{t) = (3) 

Clearly a smaller a means better synchronization in space. Final results shown below are 
averaged over 50 independent runs for each set of parameter values to warrant appropriate 
statistical accuracy with respect to the network generation and numerical simulations. 

In FiglU we have plotted A and a versus delay time r for different values of noise intensity 
D for type I delay. In accordance with the visual inspection of FigUl delay-induced reso- 
nances in A and a depending upon the increase of r are observed, where clear-cut peaks and 
valleys occur at the optimal delay time Topti — 1-8, corresponding to the most ordered spa- 
tiotemporal state ploted in FigHt^d). Following the common terminology, these are termed 
as delay-induced stochastic resonance on neuronal networks. Moreover, it is clear that as 
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FIG. 4: (a) Dependence of A on the delay time r for different noise intensity D. (b) Dependence 
of fj on r for different D. The couphng type is type I. Other parameters are the same as in Fig[T] 

D increases, the peak value in the A ~ r curve decreases monotonically and the valley in 
the 0" ~ r curve gets higher, respectively, which means increasing the noise intensity D can 
impair the resonance phenomenon, but the particular location of the Topti are robust to the 
change of -D. To make an overall inspection, the dependence of A and a on both delay time 
r and noise intensity D is shown in Fig|5l It is evident that the results presented in FigjH 
keep robust in a considerable range of r and D. 

Next, we quantitatively study the impact of type II delayed coupling on the spatiotempo- 
ral dynamics of the neuronal networks. Numerical results in Figj6] illustrate the dependence 
of A and a on the delay time r for different noise intensity D. As visually interpreted by 
space-time plots in Figl2], a spatiotemporal ordered state can not be achieved, but non-trivial 
synchronization transitions induced by time delay appear. For a given noise intensity D, 
we can see that as r is increased (e.g.,r = 0.3), a increases sharply, corresponding to the 
appearance of zigzag fronts which destroys synchronization. With further increasing delay, 
A and a pass through a peak at about r = 0.9, indicating clustering APS state which is 
periodic in time but poor in synchronization. When r increases again, e.g., to r = 1.8, A 
and a decrease clearly, corresponding to the deterioration of the APS state [See Figl2t^d)]. 
However, when r is larger than r = 2.7, A and a begin to increase again, which shows, in 
accordance with the visual inspection of Figl2](e), the emergence of clustered chimera states 
that have spatially distributed anti-phase coherence separated by incoherence. We can eas- 
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FIG. 5: (a) Contour plot of A in dependence on the delay time r and the noise intensity D. (b) 
Contour plot of a in dependence on r and D. The coupling type is type I. Delay-induced stochastic 
resonance is clearly visible. Other parameters are the same as in Figl4] 




FIG. 6: (a) Dependence of A on the delay time r for different noise intensity D. (b) Dependence 
of fj on T for different D. The coupling type is type II. Other parameters are the same as in Figl2] 

ily understand that the increasing of A and a comes from the anti-phase coherence part of 
the chimera states. In addition, the effect of the noise intensity D is similar to the results 
shown in FigJH that is to say, increasing the noise intensity D can dent the synchronization 
transitions phenomena but keeps the quaUtative behaviors unchanged. 

In FiglTl we display the contour plots of the dependence of A and a on both delay time 
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FIG. 7: (a) Contour plot of A in dependence on the delay time r and the noise intensity D. (b) 
Contour plot of a in dependence on r and D. The coupling type is type II. Other parameters are 
the same as in FigiH] 

T and noise intensity D for type II delay. It is evident the delay-induced synchronization 
transitions are robust in a large area of r and D. Furthermore, the particular location of the 
Topt2 where the peak of A appears, in accordance with the anti-phase synchronization state, 
stays almost the same as D is varied, see FigJTl^a). The value of Topt2 is about 0.9, which 
is just half of the optimal delay time Topti where the spatiotemporal ordered state emerges 
as shown in FigJS] We will return to this nontrivial point later and give some qualitative 
analysis in the discussion section. 

Actually, real neuronal networks often have complex topolo gy. In recent years, neuronal 



dynamics on complex networks, e.g., small-world (SW) ones 12|, has actually become a 
focal research topic in theoretical neuroscience 14j-ll9|. and network topology could play 
vital role in neuronal synchronization or coding dynamics. In this work, we also address such 
issues by performing similar studies on SW networks. We generate SW networks following 
the Watts-Strogatz scheme by rewiring the edges in a regular network with probability 
p. The network changes from being regular to totally random with p from to 1, but 
keeping the number of total links unchanged. We plot the dependence of spatiotemporal 
dynamics upon the delay time r for different rewiring probability p with type I and type II 
coupling in FigJHl It is noteworthy that the qualitative results achieved on regular networks 
above, i.e., the constructive roles of the two types of delayed coupling, are robust against 
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FIG. 8: Dependence of A and a on the delay time r for different rewiring probability p. (a), (b) 
Type I delayed coupling, (c), (d) Type II delayed coupling. Other parameter values are N = 200, 
= 8, and L> = 0.6. 

the rewiring probability p of the small-world network, but with some tiny quantitative 
differences. For type I coupling [see panel (a), (b)], as the network becomes more and more 
random {p increases), just similar to the effects of increasing noise intensity D, the peak 
value in the A ~ r curve decreases monotonically and the valley in the a ~ r curve gets 
higher, respectively, which means increasing the rewiring probability p can deteriorate the 
resonance phenomenon. Moreover, the optimal delay time Topti where clear-cut peaks and 
valleys appear almost retains unchanged {Topti — 1.8), indicating that Topti is not sensitive 
to the rewiring probability p. Whereas for type II coupling [see FigJHI^c) and (d)], the peak 
value in the A ~ r curve increases non-monotonically as p is increased, and just like Topti, 
the value of Topt2 always fixes at about 0.9. 
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IV. DISCUSSION AND CONCLUSION 



As stated before, both the optimal delay time Topti and Topt2 are robust to the changing 
of the noise intensity D and the rewiring probability p, and furthermore, Topt2 is almost 
half of Topti- We are thus wondering what is the underline mechanism of such an interesting 
phenomenon, and finally find that it is relevant with some intrinsic time scale of the systems. 
In Figjni we show the relationship of Topti and Topt2 to the intrinsic time scale of the systems. 
FigJU^a) and (c) depict the dependence of A on the delay time r for the model parameter 
7 = 1.8, 2.5 and 6.0 with type I and type II coupling, respectively. We can see clearly the 
optimal delay time Topti and Topt2 decrease as 7 increases, more interestingly, for a equal 7 the 
value of Topt2 is just half of Topti- Accordingly, we have calculated the normalized inter-spike 
interval histograms (ISIHs) of coupled neuronal networks without time delay to investigate 
the inherent spike period of the neuronal networks, as shown in Figj9]^b). Obviously, the 
peak position of the ISIH matches with Topti quite well, and is just twice the value of Topt2- 
In Figj9]^d), we give more quantitative illustration, where Tmax is the peak position of the 
ISIH, meaning the inherent time scale of the neuronal systems. It can be observed that as 
7 changes from 1.8 to 6.0, the optimal delay time Topti where the spatiotemporal ordered 
states emerges always equals to Tmax, which represents a kind of locking between the delay 
time and inherent spiking period of the neuronal network under the effects of noise. Whereas 
for type II coupling, Topt2 always keeps the value half of Tmax, the reason may be that type 
II delayed coupling can pull adjacent neurons into anti-phase synchronization, the optimal 
delay time Topt2 warranting the best spike regularity is not equal to one spiking period. 
Thus, it is exactly the half of the inherent spiking period of the neuronal network, where the 
phase locking between antiphased spikes occurs. In addition, we have also tried some other 
relaxation oscillator models which can describe dynamics of neurons, such as FHN model, 
and obtain similar qualitatively results. 

In summary. We have investigated temporal coherence and spatial synchronization on 
small-world networks consisting of noisy Terman-Wang excitable neurons in dependence 
on two types of time-delayed coupling. For type I coupling, we show that time delay can 
dramatically enhance temporal coherence and spatial synchrony of the noise-induced spike 
trains, and if the delay time is tuned to nearly match the intrinsic spike period of the 
neuronal network, the system dynamics reaches a most ordered state, which is periodic 
in time and nearly synchronized in space, demonstrating an interesting type of resonance 
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FIG. 9: (a), (c) Dependence of A on the delay time r for different model parameter 7 with 
type I and type II delayed coupling, respectively, (b) Normalized ISIH of coupled noisy TW 
neuronal networks without time delay for different 7. (d) Dependence of Topti,Topt2 and Tmax on 
the parameter 7. Other parameters are the same as in FiglS] 

phenomenon with delay. For type II coupling, however, a similar spatiotemporal ordered 
state never appears, but as the delay time is increased, the neurons exhibit synchronization 
transition from zigzag fronts of excitations to dynamic clustering anti-phase synchronization, 
and further to clustered chimera states that have spatially distributed anti-phase coherence 
separated by incoherence. Furthermore, we also show that these findings are robust to the 
changing of the noise intensity D and the rewiring probability p. Finally, qualitative analysis 
is given to illustrate the numerical results. Since time delays are inevitable in real neuronal 
systems, we hope that our results will be helpful for further understanding the roles of delay 
in neuron firing on realistic neuronal networks. 
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